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THE  EFFECT  OF  EXHAUST  SMOKE  OK 
AIRCRAFT  DETECTABILITY  (.U) 


I.  (c)  GENERAL 


(U)  Test  J. ]/-5. Is  being  c-r.duct vd  by  J.  i:.*  Tusk.  r r-<-  IV  , (.JTF-b)  * 
evaluate:  (a)  aircraft  vulnerability  at  low  alt.  it  ud-  t . “nt'a*."  rr.'-nt  by 

varUus  visually-.iig.ited  air  defense  weapons  and  (b)  Ur.  efi'vi.’tiv».:.*.-ss  A' 
these  weapons.  One  .f  the  objectives  .,f  these  tests  Is  to  determine  the 
relationship  between  visual  detectability  and  aircraft  distance  f r 
several  relevant  parameters,  f r example,  aircraft  altitude,  speed,  arid 
maneuver. 


(C)  Combat  experience  in  Viet  Nam  suggests  that  a '•orrelat  ion  may  ox  I: 
between  aircraft  losses  tu  gunfire  and  the  amount  (density)  of  smoke 
emitted  by  the  aircraft.  Since  an  evaluation  of  this  possible  relation- 
ship was  not  included  in  the  original  set  of  parameters  for  Test  5. 1/3*1, » 
the  Weapon  Systems  Evaluation  Group  (WSBG)  haw  requested  JTF-2  to  extend 
the  scope  of  Test  3*l/3*5  to  evaluate  the  exhaust  smoke  factor. 

(c)  The  data  obtained  via  the  current  instrumentation  system  used  for 
Test  3 • 1/3 • 5 eventually  will  permit  an  evaluation  f the  effect  of  smoke 
or.  engagement  sequence  data.  However,  WSEG  desires  that  more  limited 
information  be  made  available  innediately  after  the  relevant  trials  of 
the  field  test  are  completed.  For  thia  reason,  KumRRO  Division  No, 

F rt  Bliss,  Texas,  at  the  request  of  JTF-2,  conducted  limited  tests  using 
manual  data  collection.  HumRRO  was  responsible  for  the  collection,  reduc- 
tion and  analysis  of  this  msnually-gathered  data. 


:i.  ( r ) TEST  CONCEPT 

A.  (c)  This  portion  of  Test  3.1/3.^  obtained  data  on  visual  detect! o; 
ranges  for  two  types  of  A-U  aircraft  which  differ  significantly  in  the 
amount  of  amoke  emitted.  Hie  A-4B/C  (j-65  engine)  is  the  standard  for 
minimum  smoke  generation.  Hie  A-Ue/F  (J-52  engine)  produces  a signifi- 
cantly greater  amount  of  smoke.  Approximately  I80  trials  were  flown  to 
satisfy  the  basic  test  objective  ind  to  determine  the  effect  ..f  two  levels 
of  smoke  emission  on  detection  time. 

B.  (U)  Table  1 lists  the  combinations  f variables  scheduled  for  the 

A-l*  aircraft  trials. 

C.  (U)  In  order  that  the  influence  of  the  sec.r.dary  variables  of  the 
test  be  held  to  a minimum,  each  trial  of  an  A-i*B/C  (or  E/F)  aircraft  was 
followed  immediately  by  an  A-Ue/F  (or  B/C)  aircraft;  i.e.,  A-i+B/c  and 
A-UE/F  trials  were  paired,  with  the  two  aircraft  in  each  pair  being 
separated  in  time  over  target  by  three  to  six  minutes.  In  this  way,  the 
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effects  of  such  environmental  conditions  as  time  of  day,  sun  elevation, 
j"  azimuth  and  atmospheric  visibility  were  maintained  almost  constant.  Hie 

4*  aircraft  courses  and  maneuvers  of  succeeding  trials  were  identical  in 

order  to  present  similar  aircraft  background  conditions  to  the  observers. 

■ ' Early  warning  conditi  ns  were  constant  for  pairs  of  trials,  except  the 

altitude  and  bearing  to  the  second  aircraft  could  be  predicted  by  observers 
from  their  bservatiun  of  the  first  aircraft  in  each  pair. 


Ed.  (U)  DATA 

A.  The  amount  of  elapsed  time  between  initial  detection  and  aircraft 
crossover  was  obtained  for  each  trial.  Hiese  observations  were  made  by  a 
special  group  of  enlisted  men  provided  by  USCQNAHC.  Hiis  group  of 
"Timers"  had  not  participated  in  the  earlier  phase  of  the  HLMR  tests. 

I).  A second  group  of  observers,  "Sm  >ke  Judges".  provided  opinion 
data  concerning  the  relative  amount  of  smoke  emitted  for  selected  random 
pairs  of  A~hC  and  A-4E  trials.  After  certain  specified  pairs  of  trials, 
these  Smoke  Judges,  who  were  selected  from  crewmen  not  serving  as  gun 
crew  participants  at  the  time,  were  asked  three  questions  by  the  Timers: 

1.  Which  of  the  two  previous  aircraft  was  easier  to  detect? 

2.  Did  the  two  aircraft  show  the  same  amount  of  smoke? 

3.  If  not,  which  aircraft  showed  more  smoke? 

IV.  (U)  DETAILED  OBSERVER  PLAN 

A.  Observers.  As  stated  above,  two  different  groups  of  observers 
(Timers  and  Smoke  Judges ) were  used  to  obtain  the  two  types  of  performance 

data. 

1.  Group  1,  "Timers":  Ten  EM,  equipped  with  stop  watches  and 

recording  forms,  measured  and  recorded  the  elapsed  time  from  detection  tc 
crossover  for  each  trial,  rnese  observers  were  selected  and  trained  in 
the  test  procedures  by  HumRRO.  Six  observers  were  provided  by  the  U.S. 

Army  Air  Defense  Human  Research  Unit,  and  four  were  obtained  from  the  U.S. 
Army  Training  Center  Human  Research  Unit. 

2.  Group  2,  "Smoke  Judges":  On  each  test  day,  ten  CPEC  EM, 

currently  assigned  as  crewmen  for  the  air  defense  weapons  provided  judg- 
ments of  the  relative  smoke  density  of  the  aircraft  for  selected  pairs  of 
trials.  The  smoke  judges  were  selected  from  CDEC  enlisted  men  who  were 
serving  as  gun  crew  participants  at  the  time. 
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B.  Observer  Location.  Within  each  weapon  complex,  the  Timers  were 
stationed  close  to  AD  weapons  so  they  received  the  early  warning  informa- 
tion normally  provided  for  each  trial.  The  proximity  of  these  timers  to 
the  weapon  crews  also  facilitated  administration  of  the  smoke  questionnaire 
to  tiie  Smoke  Judges.  The  location  of  the  specific  weapon  sites  used  by 
the  Timers  is  3hown  in  Figure  1,  along  with  plan  projections  of  the  air- 
craft flight  paths. 

C.  Test  Monitors.  The  Timers  at  each  Weapon  Complex  were  under 
the  supervision  of  a SMOKEHOUSE  Monitor,  who  had  the  following  responsi- 
bilities : 


1.  At  beginning  of  each  AM  and  PM  test  sessions,  the  Monitor 
acccmpliuhed  a "head  count"  to  determine  that  the  correct  group  of  timing 
observers  were  present  at  the  complex. 

2.  He  issued  timing  and  recording  equipment. 

3.  He  determined  that  each  Timer  had  a properly-functioning 
stop  watch,  the  appropriate  recording  forms,  and  pencils  and  clip-board. 

U.  He  determined  that  the  Timers  had  the  appropriate  trial 
schedule,  questionnaire  forms,  and  information  concerning  the  identity  of 
the  CDEC  "Smoke  Judges"  for  the  session. 

5.  He  monitored  the  Timers  during  the  test  session  to  insure 
that  all  required  activities  were  being  accomplished. 

D.  Rotation  of  Observers,  On  each  test  day  the  10  Timers  were 
randomly  assigned  to  a specific  weapon  site  to  be  used  for  the  day. 

Fo?  .owing  completion  of  the  AM  trials  (and  noon  mess)  it  was  planned  to 
rotate  the  Timers  each  day  so  that  all  Timers  would  make  an  equal  number 
of  observations  at  each  of  the  10  selected  weapon  sites. 

E.  Daily  Procedure. 

1.  Measuring  Elapsed  Time.  Hie  Timers  remained  at  the  weapon 
site  and  received  the  early  warning  (EW)  information  given  the  crewmen  by 
the  CDEC  controller.  Upon  receipt  of  EW,  the  Timers  began  visual  search 
of  the  designated  sky  space. 

When  an  aircraft  was  detected,  the  Timer  started  the  stop 
watch.  When  the  aircraft  reached  the  crossover  point,  the  Timer  stopped 
the  watch  and  printed  the  elapsed  time  (to  the  nearest  second)  for  the 
trial  on  the  record  form. 
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Figure  1.  Observer  Locations  at  Weapon  Sites'  (u) 
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2.  Smoke  Judgments.  Following  the  completion  of  the  specially 
selected  pairs  of  trials,  the  Timers  administered  the  Smoke  Questionnaire 
to  the  crewmen  in  each  complex  who  had  been  designated  as  "Smoke  Judges" 
for  the  AM  (or  PM)  test  session.  The  questionnaires  provided  the  following 
information: 

a.  The  "Smoke  Judge's"  name  and  serial  number. 

b.  The  numbers  of  the  trials  being  compared. 

c.  The  weapon  complex  and  weapon  location  number. 

d.  The  time  of  day  (to  the  nearest  minute). 

e.  The  "Judge's"  answers  to  the  three  questions. 

V.  (C)  RESULTS 

A.  (c)  Elapsed  Time  Data. 

1.  (c)  Average  Time  for  All  Trials.  A total  of  960  paired  obser- 
vations were  made  of  the  E and  B aircraft.  The  average  (mean)  elapsed 

time  difference  between  the  two  types  was  4.97  seconds,  with  the  A-4e 
being  detected  before  the  A-4B.  This  difference  was  statistically 
reliable  at  p < .01  (Student's  t = 6.68,  with  959  degrees  of  freedom). 

2.  (C)  Average  Time  for  Valid  Trials.  Inspection  of  the  time  in 
view  measures  indicated  that  on  many  trials  the  aircraft  were  detected 
after  Early  Warning  had  been  announced  but  before  the  aircraft  actually 

was  on  the  assigned  course  and  at  the  scheduled  altitude  for  the  trial. 

In  many  instances  the  aircraft  apparently  were  detected  while  on  the 
l80-degree  leg  of  the  approach  to  the  course.  Since  these  trials  would 
not  provide  valid  comparisons  for  the  two  types  of  aircraft  for  each 
combination  of  altitude  and  course,  the  data  were  screened  to  eliminate 
the  erroneously  long  time  measures; 

a.  For  flights  on  the  Valley  A Course,  all  time  in  view 
measures  exceeding  60  seconds  were  dropped. 

b.  For  the  Crossing  flights  (N,  C,  and  S),  all  time 
measures  exceeding  45  seconds  were  eliminated. 

c.  No  observations  were  eliminated  for  the  Maneuver  2 
flights  on  the  E Course. 

If  one  score  of  a pair  had  to  be  dropped,  both  scores  were  dropped. 

After  eliminating  the  invalid  pairs  of  observations,  a 
total  of  739  paired  observations  remained.  For  these  remaining  valid 
observations,  the  mean  detection  time  for  the  A-4E  was  2. 30  seconds 
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earlier  than  the  A-^B.  This  difference,  while  small,  was  statistically 
reliable  (Student's  t - 5*00,  with  73<^  degrees  of  freedom). 

3 • ( C ) Average  Time  Differences  fur  Courses  and  Altitudes. 

Table  2 presents  the  time  differences  with  reference  to  the  test  matrix 
of  courses  and  altitudes.  These  comparisons  are  of  the  739  "valid" 
trials  only.  A negative  time  difference  indicates  that  the  B aircraft 
was  seen  before  the  E aircraft. 

The  statistical  analysis  indicated  that  the  E type  was 
reliably'  seen  before  the  B type  for  course-altitude  combinations  A-l,  A-2, 
and  C-2.  In  contrast,  the  B-engined  aircraft  were  seen  be  fore  the 
E-engined  type  for  S-l  and  C-l.  The  negative  difference  for  N-l  was  not 
statistically  reliable  at  p = .10.  As  stated  earlier,  when  averaged  over 
all  courses  and  altitudes,  the  A-4E  was  seen  earlier  than  the  A-UB. 

(C)  Comparison  of  Test  Sites.  The  mean  differences  (E  minus  B) 
for  all  observations  made  at  each  of  the  10  weapon  sites  is  shown  in 
Table  3«  Analysis  of  the  data  for  each  weapon  site  indicated  that  for 
three  of  the  sites  (ill,  113;  and  117)  the  E-engine  aircraft  were 
detected  reliably  before  the  B-engined.  At  one  test  site  (ll6)  the 
opposite  result  occurred,  and  at  those  sites  having  very  near  terrain 
mask  (131;  132,  and  133)  there  were  no  reliable  differences  between  the 
two  engine  types. 

'.  (C)  Comparison  for  Each  Altitude  at  Maneuver  1.  The  paired 

observations  were  also  averaged  over  trie  A,  S,  C,  and  fl  courses  to  compare 
the  elapsed  time  difference  for  each  altitude  for  the  flights  using 
Maneuver  1.  On  the  average,  tne  E aircraft  were  seen  before  the  B types 
2.12  seconds  at  Altitude  1 and  2.97  seconds  at  Altitude  2.  Both  of  these 
mean  differences  were  statistically  reliable  at  p = .10  or  less  (Student's 
t's  were  3-53  and  b.^Q,  respectively). 

B.  (U)  Average  Time  in  View.  The  mean  and  standard  deviation  of  the 
actual  time  in  view  for  -’ach  aircraft  flight  is  shown  in  Appendix  A for 
each  combination  of  test  parameters.  This  form  of  the  data  should  be  of 
interest  to  those  agencies  having  knowledge  of  the  terrain  unmask  dis- 
tances arid  the  actual  aircraft  speeds. 

0.  (c)  Smoke  Judgments.  Prior  to  the  actual  test,  twenty  pairs  of 

trials  were  selected  for  collecting  the  opinions  of  observers  concerning 
the  eas  of  detection  and  amount  of  smoko  emitted  by  each  aircraft  in  a 
pair.  After  completion  of  each  of  these  selected  trial-pairs,  the  Timers 
asked  three  questions  of  the  CDEC  "Smoko-  Judges".  Hie  Timers  also 
answered  the*  questions  before  questioning  the  O' DEC  Judges. 
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Table  3 (c) 

Elapsed  Time  Differenc  s for  Each  Weapon  Site  (u) 


Weapon  Site 

No.  of 
Pairs 

— 

Mean 

Diff. 

Stat.  - / 
Reliable^ 

110 

91 

1.10 

No 

111 

79 

7.49 

Yes 

112 

64 

2.86 

No 

113 

84 

6.19 

Yes 

n4 

74 

0.86 

No 

116 

103 

- 1.33 

Yes 

117 

74 

3.57 

Yes 

131 

51 

- 0.49 

No 

132 

37 

2.67 

No 

133 

62 

0.15 

No 

y 


Statistically-  reliable  at  p = .10  or  less 
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(C)  The  20  pairs  of  trials  were  selected  to  counterbalance  the 
sequence  in  which  the  E and  B aircraft  appeared,  and  to  include  several 
altitudes  and  courses.  Two  pairs  of  trials  involving  successive  flights 
of  the  same  engine  type  were  included  to  provide  a means  of  determining 
if  the  Judges  exhibited  any  biases:  For  example,  did  judges  tend  to  rate 

the  second  aircraft  of  a pair  as  emitting  more  smoke  than  the  first  air- 
craft. Hie  questionnaire  results  are  shown  in  Table  k.  Of  327  answers, 

73$  of  the  judgments  indicated  that  the  A-UE  was  easier  to  detect.  Ninety- 
seven  percent  of  the  judgments  indicated  that  the  observers  were  aware  of 
differences  in  the  smoke  output,  and  90$  of  the  time  the  more  dense 
exhaust  smoke  was  associated  with  the  A-4E. 


VI.  (C)  DISCUSSION 

A.  (C)  Elapsed  Time  Differences.  The  rather  perverse  nature  of  the  E 
versus  B time  comparisons  obtained  for  the  various  courses  and  altitudes 
warrants  some  speculation.  Hie  results  suggest  that  as  the  terrain 
unmask  distance  increased,  the  B-engined  aircraft  were  more  difficult  to 
detect.  Hiis  difference  was  probably  most  dramatically  reflected  in  the 
mean  E vs.  B difference  obtained  before  the  off-course  detections  were 
eliminated.  The  comments  of  the  Timers  and  Test  Monitors  indicated  that 
these  invalid  observations  tended  to  occur  when  the  aircraft  was  at  a 
high  altitude  and  in  its  glide  path  to  the  programmed  test  altitude.  That 
is,  the  aircraft  were  well  above  terrain  and  became  apparent  against  a 
sky  background.  Unfortunately,  information  concerning  the  aircrafts' 
actual  altitudes  at  the  time  these  "invalid"  detections  occurred  cannot 
be  correlated  with  the  detection  times,,  because  the  latter  did  not  share 
a common  time  base  with  the  3*l/3*5  instrumentation  system. 

(o')  However,  when  the  invalid  observations  were  deleted  from  the 
statistical  analysis,  the  approximately  five  seconds  greater  detectability 
of  the  E-engined  aircraft  decreased  to  2.3  seconds.  That  is,  as  the 
amount  of  masking  increased,  the  detection  difference  decreased. 

(C)  The  most  curious  result  concerned  the  greater  detectability  of 
the  B-engined  aircraft  while  flying  the  crossing  courses  at  Altitude  1. 

All  averages  for  the  Altitude  1 flights  on  the  N,  C,  and  E courses  indicated 
that  the  B-engined  aircraft  were  seen  earlier.  It  would  be  expected  that 
the  E-engined  aircraft  would  produce  very  dense  smoke  at  this  altitude. 

Since  most  of  the  crossing  flights  at  Altitude  1 had  a sky  background  at 
the  time  of  unmask,  the  greater  smoke  output  of  the  E-engined  aircraft 
would  have  further  increased  its  detectability.  It  can  only  be  guessed 
that,  for  some  reason,  when  on  the  crossing  courses  the  B-engined  aircraft 
tended  to  fly  at  a slightly  higher  altitude  than  the  A-^-E.  One  can  spiecu- 
late  that  performance  characteristics  of  the  A-4b  when  at  low  altitude 
may  have  caused  the  pilots  to  seek  a little  extra  altitude  when  flying 
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over  the  rolling  terrain  and  approaching  the  prominent  hill  which  intersected 
the  crossing  courses.  Additional  light  can  be  east  ur;  this  problem  when 
the  aircraft  altimeter  data  is  obtained  by  JTF-2. 

B.  (c)  Smoke  Judgments.  The  results  of  the  questionnaires  given  after 
selected  pairs  of  trials  are  not  too  informative.  The  results  indicate 

that  the  observers  were  very  much  aware  of  the  differences  in  the  quantity 
of  smoke  produced  and  tended  to  believe  that  the  smoky  aircraft  were 
easier  to  detect.  Unfortunately,  the  observers  were  often  incorrect  in 
their  evaluation  of  specific  situations. 

C.  (C)  Timers  and  Monitors  Comments.  In  canparing  the  two  engine 
types  at  sites  131,  132,  and  133,  test  observers  reported  that  the 
E-engined  aircraft  was  not  as  easily  detected  on  the  Valley  A course 
because  the  aircraft  usually  had  a terrain  background  when  it  unmasked  at 
Altitude  1.  It  appeared  that  the  smoke,  which  aided  detection  of  the 
A-UE  by  other  weapon  sites,  was  not  discriminable  when  the  aircraft  had  a 
terrain  background. 

(c)  In  discussing  the  observation  of  the  flights  using  Maneuver  2, 
test  observers  reported  that  the  aircraft  usually  was  detected  while  it 
was  accomplishing  the  climbing  portion  of  the  maneuver.  At  this  time, 
the  aircraft  presented  a lateral  (side  view)  rather  than  . head-on  aspect 
to  the  observers.  Since,  at  any  distance,  the  lateral  aspect  subtends  a 
larger  solid  visual  angle  than  a head-on  aspect,  early  detection  of  both 
types  of  aircraft  tended  to  occur.  Also,  in  reference  to  Maneuver  2,  the 
observers  reported  that  they  did  not  become  aware  of  the  exhaust  smoke  of 
the  E-engine  aircraft  until  it  had  completed  its  climb  and  begun  to  roll 
over.  As  the  aircraft  aspect  changed  to  head-on,  the  exhaust  smoke 
seemed  to  "blossom",  probably  because  the  observers  were  viewing  the  end 
of  a "tube  of  smoke"  rather  than  looking  at  the  much  less  dense  side  of 
the  "smoke  tube".  However,  most  frequently  detection  of  the  Maneuver  2 
flights  had  already  occurred  before  the  exhaust  blossomed.- 
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